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describes the early implementation of the NCLB accountability provisions, 
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Federal policy has played a major role in supporting standards-based reform since 
the passage of the Improving America’s Schools Act (IAS A) of 1994. That law required 
states to establish challenging content and performance standards, implement assessments 
that measure students’ performance against these standards, hold schools and school 
systems accountable for the achievement of all students, and take other steps to promote 
programmatic flexibility and to foster instructional and curricular reform. 

During the mid- and late- 1990s, states and school districts began to move in the 
direction of standards-based reform, consistent with the intent of LASA. But state policy 
responses were uneven. While all states developed assessments, standards, performance 
reporting, and in most cases, consequences for performance, states found different ways 
to define what it meant for schools to succeed, what indicators to include in their 
definition of success, and what the consequences would be (Goertz and Duffy, 2001). 

The No Child Left Behind Act (NCLB) of 2001 was designed, in part, to address 
this variability in state policy. With the enactment of this law, the federal government 
has increased its role in state education policy significantly. Specially, in the areas of 
assessment and accountability, the NCLB Act: 

• Expands required testing in reading and mathematics from at least once during 
each of three grade spans — third-to-fifth, sixth-to-ninth, and tenth-to- 
twelfth — to every student, annually, in grades three through eight, as well as 
once in high school; 

• Adds tests in science starting in 2007-08, and requires LEAs to assess the 
English proficiency of English language learners starting this year; 

• Requires states to measure the progress of aft schools and school districts 
using the same definition of adequate yearly progress; 

• Establishes a target date — 2013-14 — by which all students must score at a 
state-defined "proficient" level; 

• Specifies how states should measure adequate yearly progress; 

• Holds schools, school districts and states accountable for the yearly progress 
of subgroups of students; 

• Delineates the types of corrective action that states and districts should take 
when Title I-funded schools fail to improve; and 
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• Shortens the timeline for imposing sanctions on Title I schools that fail to 
improve (e.g., requires public school choice after two years of not making 
adequate yearly progress, the provision of supplemental services after three 
years, and the application of corrective actions after four years.) 

This paper focuses on the challenges that states face as they implement the 
accountability provisions of the NCLB Act, particularly those related to the identification 
and assistance of schools in need of improvement. Studies are underway that examine 
the implementation of some of the NCLB sanctions, such as the supplemental services 
requirement. 1 I begin this paper by looking at the status of state assessment and 
accountability policy prior to the enactment of the NCLB to give readers a sense of the 
types and extent of changes required of states. The second section describes the early 
implementation of the NCLB accountability provisions, primarily the development and 
approval of state accountability plans, and raises a number of design and implementation 
issues that states face. The last section identifies three factors — the lack of fiscal 
resources, limited human resources, and potentially the identification of a large number 
of schools for assistance — that may create the conditions for a Perfect Storm. 

Status of State Policy pre-NCLB 

When Congress enacted the NCLB Act, states were at different stages of meeting 
these expanded requirements (Goertz and Duffy, 2001; NATI/ERP, 2001; U.S. 
Department of Education, 2001a). In the area of assessment, for example, forty-eight 
states had implemented statewide assessments in reading and mathematics by 2001. But 
only 13 states and the District of Columbia tested consecutive grades between grades 2 or 
3 and at least grade 8 in the same subject areas using the same assessment, as required by 
the NCLB. Another 3 states tested consecutive grades between grades 2 or 3 and 8 in 
different subjects and/or using multiple assessments. The other 32 states tested students 
in only one or two grades per subject in elementary school, middle school and high 
school, as required by the IASA. 

With respect to accountability, while the intent of the IASA was to create single 
and "seamless" accountability systems that would treat all schools equally, only 22 states 
had single accountability systems in place by 2000-2001. More than half of the states 
had dual accountability systems where Title I schools were subject to different measures 
of adequate yearly progress. Thirteen of these states used public reporting as their 
primary accountability mechanism for non-Title I schools. States also differed in the 
percentage of students that schools were expected to bring up to their "proficient" 
standard (only seven states expected 90 to 100 percent of their students to reach 
proficiency); timelines for meeting these performance goals (if they had timelines); and 
how they measured adequate yearly progress. Only one-third of the states focused on 
closing the gap between low- and high-achieving students in their Title I schools, and 
only two states required schools to close achievement gaps between White students and 
students of color, between economically disadvantaged and economically advantaged 



1 For example, SRI International, Case Studies of the Implementation of NCLB Supplemental 
Educational Services, for the U.S. Department of Education. 
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students, between students with and without disabilities, or between English-dominant 
and limited English-speaking students. 

Thus, states had a long way to go to meet the assessment and accountability 
requirements of the NCLB Act, as well as the other myriad provisions of the new law. 
No state had a system in place that met all of the provisions of the law. 

Implementation of the NCLB Accountability Provisions 
Developing State Plans 

All states had to submit state accountability plans to the U.S. Department of 
Education (USED) by January 31, 2003 for review and approval by the Secretary of 
Education. State plans must meet ten criteria issued by Secretary Paige on July 24, 2002 
and referenced to the NCLB legislation (Paige, 2002). These criteria are: 

1 . A single statewide accountability system applied to all public schools and 
LEAs. 

2. All public school students are included in the State accountability system. 

3. A State’s definition of adequate yearly progress (AYP) is based on 
expectations for growth in student achievement that is continuous and 
substantial, such that all students are proficient in reading and math no later 
than 2013-14. 

4. A State makes annual decisions about the achievement of all public schools 
and LEAs. 

5. All public schools and LEAs are held accountable for the achievement of 
individual subgroups. 

6. A State’s definition of AYP is based primarily on the State’s academic 
assessments. 

7. A State’s definition of AYP includes graduation rates for high schools and an 
additional indicator selected by the State for middle and elementary schools 
(such as attendance rates.) 

8. AYP is based on separate reading/language arts and math achievement 
objectives. 

9. A State’s accountability system is statistically valid and reliable. 

10. In order for a school to make AYP, a State ensures that it assess at least 95% 
of students in each subgroup enrolled. 
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Each state undergoes an on-site peer review of its plan by a five-person team 
composed of one staff member from the U.S. Department of Education’s Student 
Achievement and School Accountability Office (Title I), a representative of the Office of 
Assistant Secretary for Elementary and Secondary Education, and three external 
reviewers with expertise in assessment and accountability. Some of the external 
reviewers are researchers; many are current or retired state department of education 
assessment and accountability directors. The three peer reviewers submit a report to the 
USED that assesses the strengths and weaknesses of the state plan. The Department then 
works with each state to finalize a plan that will gamer federal approval. The peer 
review site visits should be completed by the end of April 2003, with a projected 
approval date for all plans of June 2003. Ten state plans had been approved as of April 
16, 2003, and are posted on the USED’s website. 2 These plans and reviews do not 
include information on, or evaluations of, corrective actions (e.g., choice, supplemental 
services, reconstitution) or of proposed technical assistance by states or LEAs to schools 
identified as in need of improvement. States that expand and/or change their state 
assessment systems in response to the NCLB Act will undergo a separate assessment peer 
review. 



States struggled to develop accountability plans with limited guidance from the 
USED. In June 2002, Secretary Paige began sending a series of policy letters to the 
chief state school officers, sometimes in response to questions raised by these state 
leaders. Final regulations for the NCLB were not issued until November 26, 2003, two 
months before plans were due. As a result, states turned to each other, to their member 
organizations (such as the Council of Chief State School Officers and the Education 
Commission of the States) 3 and to consultants for help in preparing their plans. Many 
states also looked for guidance in the provisions of the first state plans approved by the 
Secretary of Education in early January 2003. 

Design Issues 



There has been considerable discussion in the policy, political and research 
communities about the type and extent of flexibility states have in responding to the 
requirements of the NCLB Act. With regard to accountability, some provisions allow no 
flexibility. For example, some state accountability systems used a performance index 
that combined performance on reading and mathematics (a compensatory model). States 
now have to hold schools and districts accountable separately for reading and 
mathematics (a conjunctive model). States must calculate AYP separately for all students 
and all subgroups of students in a school and school district. Also, states must follow the 
NCLB provisions for establishing “starting points” for the AYP targets, 4 as well as 

2 The ten states are Colorado, Delaware, Indiana, Kansas, Maryland, Massachusetts, Mississippi, 
New York, Ohio and West Virginia. The website is: www.ed.gov/offices/OESE/CFP/csas/ . 

3 See for example, Education Commission of the States (2002) and related information on their 
website, www.ecs.org; Forte-Fast and ASR SCASS (2002); CCSSO (2002). 

4 The starting point — the percentage of students proficient of higher on the statewide 
assessment — must be established separately for reading and mathematics, but states have the 
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